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Poor agreement between QuantiFERON-TB 
Gold test and tuberculin skin test results for the 
diagnosis of latent tuberculosis infection in 
rheumatoid arthritis patients and healthy controls 

Joo-Hyun Lee\ Hae Sook Sohn^, Jin Ho Chun^, Hyoun-Ah Kim^ Chang Hee Sutf , Yun Woo Lee'*, 
and Bo Young Yoon^ 

Background/Aims: We investigated the agreement between the QuantiFER- 
ON-TB Gold (QFT-Gold) test and the tubercuhn skin test (TST) in the diagnosis 
of latent tuberculosis infection in patients with rheumatoid arthritis (RA), com- 
pared with healthy controls, in Korea. 

Methods: We recruited 64 patients with RA and 79 healthy controls at two uni- 
versity hospitals in South Korea. The participants underwent both the QFT-Gold 
test and the TST simultaneously between August 2006 and February 2009. All 
patients were diagnosed using the classification criteria for RA revised in 1987 
by the American College of Rheumatology. Bacillus Calmette-Guerin vaccina- 
tion status and current medications were evaluated, and disease activities were 
assessed using the Disease Activity Score in 28 joints. Eleven patients with RA 
produced indeterminate QFT-Gold test results and were thus excluded from the 
kappa analysis. 

Results: Based on an induration of 10 mm in diameter as the TST cutoff value, 
the QFT-Gold test and TST demonstrated 75.0% agreement (k = 0.23) in patients 
with RA and 75.9% agreement (k = 0.19) in healthy controls. Among the 56 patients 
with RA who had negative TST results, 11 patients (17.2%) also yielded indetermi- 
nate QFT-Gold results. 

Conclusions: Our study showed poor agreement between the results of the QFT- 
Gold test and the TST in both RA patients and healthy controls. Based on these 
findings, we emphasize the importance of making clinical decisions in the diag- 
nosis of latent tuberculosis in Koreans with or without RA. 
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INTRODUCTION 

The accurate diagnosis of latent tuberculosis infection 
(LTBI) has become an important issue in the field of 



rheumatology. Patients with rheumatoid arthritis (RA) 
are at increased risk of developing serious infections, 
which, in Korea, commonly manifests as tuberculosis 
(TB). 
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In the detection and prophylactic treatment of LTBI, 
diagnostic tools for LTBI are used to decide whether 
antitumor necrosis factor-a (anti-TNF-a) agents 
should be administered [i]. There is an intermediate 
prevalence of active pulmonary TB in Korea, and Ba- 
cillus Calmette-Guerin (BCG) vaccination is mandato- 
ry [2]. The accuracy of the tuberculin skin test (TST) 
for the diagnosis of LTBI is controversial, especially 
with regard to TB burden, BCG vaccination, and im- 
mune status [3,4]. Despite these limitations, the TST is 
used routinely in hospital clinical practice to screen 
for LTBI. 

Two new interferon (IFN)-y release assays may offer 
improved specificity and sensitivity over the TST for 
the diagnosis of LTBI [5,6]. One of these, the QuantiF- 
ERON-TB Gold (QFT-Gold), showed encouraging 
results in low-risk BCG-vaccinated subjects [7] and 
patients with active TB [6]. QFT-Gold overcomes some 
of the shortcomings of the TST, such as the need for 
return visits, reader variability, variable specificity, 
and cross reactivity with BCG vaccination and nontu- 
berculous mycobacterial infections [8-10]. Although 
these tests are valuable in screening for LTBI, the di- 
agnostic accuracy varies according to the patient pop- 
ulation. Furthermore, several studies in Korea have 
suggested a discordance between the QFT-Gold test 
and the TST [11-13]. O^i^ study showed a poor correla- 
tion between the TST and the IFN-y assay in healthy 
Korean volunteers [11]. Two other studies reported 
poor agreement between TST and IFN-y assay results 
in Korean patients with RA [12,13]. 

However, it remains unclear whether the QFT-Gold 
test can replace the TST in patients with RA or in the 
general population of Korea. We need clear practice 
guidelines for the diagnosis and treatment of LTBI to 
reduce the TB infection rates in patients with rheuma- 
tologic diseases who receive anti-TNF-a agents. How- 
ever, there are no reported estimates of the concor- 
dance between the two diagnostic tools for LTBI in 
patients with RA or healthy volunteers in Korea. 

Thus, in this study, we investigated the agreement 
between the QFT-Gold test and the TST in patients 
with RA and healthy controls to assess differences be- 
tween the laboratory tests and the testers. We also esti- 
mated the clinical significance of indeterminate QFT- 
Gold results. 



METHODS 
Study population 

We enrolled 64 patients with RA at two university hos- 
pitals in South Korea between August 2006 and Feb- 
ruary 2009. Patients with RA were diagnosed accord- 
ing to the RA criteria set in 1987 by the American 
College of Rheumatology. None of the patients had 
been administered an anti-TNF-a agent. Among the 
candidates who visited during above period (n = 79), 
patients were excluded for a history of recent contact 
(within 3 months) with active TB patients, incomplete 
TB treatment, no consent, or no measured induration 
(n = 15). The control group consisted of 79 apparently 
healthy volunteers selected from a group of medical 
students and family members of admitted patients 
who had no previous history of TB and no known di- 
rect contact with TB patients. Hospital staff who had 
direct contact with TB patients, current hospital pa- 
tients, chronic diseases or immunosuppressive drug 
treatments, or skin allergy disease or hypersensitivity 
were excluded from the control group. 

All patients and the healthy volunteers were inter- 
viewed regarding their personal TB history. We per- 
formed a retrospective chart review of the medical 
history of each patient (e.g., the use of glucocorticoids 
and methotrexate [MTX], the presence of rheumatoid 
factor [RF], Disease Activity Score in 28 joints [DAS28], 
and disease duration). BCG vaccinations were verified 
by BCG scar identification and recorded. Chest radio- 
graphs were performed within 3 months before the 
QFT-Gold test and TST and were evaluated by an ex- 
perienced radiologist. 

All enrolled persons provided informed consent un- 
der Institutional Review Board-approved protocols at 
both Inje University Ilsan Paik Hospital and Ajou Uni- 
versity Hospital. 

TST 

Trained technicians performed the TST on the volar 
side of the forearm using the Mantoux method. A 2-TU 
dose of tuberculin-purified protein derivative (PPD 
RT23, Staten Serum Institute, Copenhagen, Denmark) 
was injected intradermally and read after 48 to 72 hours. 
The TST results were interpreted according to the cur- 
rent guidelines for LTBI in anti-TNF-a agent users in 
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Korea. The QFT-Gold and TST were performed on the 
day in each patient during the study period. 



same 



QFT-Gold 

The QFT-Gold test was performed at the central labo- 
ratory of the Korea Green Cross Corporation accord- 
ing to the manufacturer's recommendations. Briefly, 
whole blood specimens were incubated for 20 hours 
(overnight) at 37°C in a humidified atmosphere. The 
IFN-y level of a nil well was considered background 
and was subtracted from the results of the mitogen 
well and the antigen-stimulated wells. The test result 
was considered positive if the concentration of IFN-y 
in the sample well after stimulation with early secre- 
tory antigen target 6 and/or culture filtrate protein 10 
was a 0.35 lU/mL (after subtracting the nil well value), 
regardless of the result of the positive control (mitogen 
well). The test result was considered negative if the re- 
sponse to the specific antigens (after subtraction of the 
nil well value) was < 0.35 lU/mL and if the IFN-y level 
of the positive control (after subtraction of the nil well 
value) was > 0.5 lU/mL. The test result was considered 
indeterminate if both antigen-stimulated sample 
wells were negative (< 0.35 lU/mL after subtraction of 
the nil well value) and if the value of the positive con- 
trol well was < 0.5 lU/mL (after subtraction of the nil 



well value). 
Statistical analysis 

Demographic characteristics are presented as means ± 
SD (range) and categorical variables are expressed as 
frequencies. The cutoff value for the TST was based on 
an induration of 10 mm in diameter. The agreement 
between the QFT-Gold test and the TST was calculat- 
ed using standard kappa statistics. The agreement be- 
tween two tests in patients with RA taking glucocorti- 
coids and MTX was also calculated. The test results 
were evaluated using Cohen's kappa (k), > 0.75 indicat- 
ed good agreement, k = 0.4 to 0.75 indicated fair to 
good agreement, and k < 0.40 indicated poor agree- 
ment. 

We subanalyzed the indeterminate QFT-Gold rates 
according to glucocorticoid and MTX dose, serum RF 
positivity rate, and history of BCG vaccination. All 
analyses were performed using the SPSS software ver- 
sion 18.0 (IBM Co., Armonk, NY, USA). 



RESULTS 

Demographic data and clinical characteristics of pa- 
tients with RA and the control group are presented in 



Table 1. Demographic data and clinical characteristics 



Characteristic 


RA 


Healthy controls 


p value 




Number 


64 


79 






Age, yr 


55.5 ± 11.9 


44.4 ±18.4 


< 0.001 




Sex, female/male 


58/6 


46/33 


< 0.001 




BCG vaccination rate 


34(53-1) 


59 (747) 


0.007 


1 


History of tuberculosis 


4(6.3) 


3(3-8) 


0.499 




Disease-related factors 


Disease duration, mon 


58.3 ± 79.9 


NA 






RF positivity, % 


56.3 


NA 




1 


DAS28 


3.9 ± 2.0 


NA 






Treatment at recruitment 










Use of steroid (conversion to PDL) > 5 mg daily 


11 ± 17.2 


NA 






Use of MTX 


52(81.3) 


NA 




1 


Current MTX dose, mg/wk 


8.4 ±5.1 


NA 







Values are presented as mean ± SD or number (%). 

RA, rheumatoid arthritis; BCG, bacillus Calmette-Guerin; NA, not applicable; RF, rheumatoid factor; DAS28, Disease Activity 
Score 28-joint count; PDL, prednisolone; MTX, methotrexate. 
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Table 2. Agreement between QuantiFERON-TB Gold and tuberculin skin rest results in enrolled participant and immunosu- 
pressive therapy 





QFT-Gold(-) 


QFT-Gold(+) 


Total 


K (95% CI) 


Patients with RA (n = 53) 








0.23 (-0.10-0.56) 


TST (-) 


39 


6 


45 


J 


TST (+) 


5 


3 


8 




Total 


44 


9 


53 


1 


Healthy controls (n = 79) 








0.19 (-0.04-0.42) 


TST (-) 


i6 


3 


59 


1 

J 


TST (+) 


16 


4 


20 




Total 


72 


7 


79 


1 


Patients taking glucocorticoids (n - 43) 








0.28 (-0.07-0.63) 


TST(-) 


31 


3 


34 


1 

J 


TST (+) 


6 


3 


9 




Total 


37 


6 


43 




Patients taking MTX (n = 38) 








0.21 (-0.17-0.59) 


TST (-) 


28 


3 


31 




TST (+) 


5 


2 


7 




Total 


33 


5 


38 





RA, rheumatoid arthritis; TST, tuberculin skin test; QFT-Gold, QuantiFERON-TB Gold; MTX, methotrexate; CI, confidence 
interval. 




Table 1. We enrolled 64 patients with RA (58 females, 
six males) and 79 healthy controls (46 females, 33 males). 
Compared with the RA patients, the mean age of the 
controls was younger (55.5 years vs. 44.4 years; p < 0.001), 
and the ratio of female patients was lower (90.6% vs. 
58.2%; p < 0.001). Among the study populations, 34 pa- 
tients (53.1%) with RA and 59 healthy controls (74.7%) 
had received the BCG vaccination [p = 0.007). 

In the RA patients, the mean disease duration ± SD 
was 58.3 ± 79.9 months and the RF positivity rate was 
56.3%. The mean DAS28-joint count ± SD was 3.9 ± 2.0. 
At the time of recruitment, the number (%) of RA pa- 
tients taking glucocorticoids (conversion to predniso- 
lone) in doses > 5 mg/day was 11 (17.2), and the daily 
mean doses of glucocorticoids were 3.2 ± 3.8 mg. The 
number (%) of patients taking MTX was 52 (81.3), and 
their current MTX doses were 8.4 ± 5.1 mg/week. 

In the evaluation of both RA patients and healthy 
control for whom both test results were available, in- 
determinate QFT-Gold results were observed in 11/143 
individuals (7.7%). Interestingly, all indeterminate 
QFT-Gold results were in patients with RA who had 



negative TST results (Fig. 1). We did not observe inde- 
terminate QFT-Gold results in the healthy controls or 
in patients with RA who had positive TST results. In 
the healthy controls, the TST positivity rate (25.3%) was 
higher than that of the QFT-Gold test (8.9%), whereas 
in RA patients, the TST positivity rate (12.5%) was sim- 
ilar to the QFT-Gold positivity rate (14.1%) (Table 2, 
Fig. 1). 

We excluded the results of 11 RA patients whose 
QFT-Gold test yielded indeterminate results in our 
agreement analyses. The overall agreement between 
the QFT-Gold and TST results was low, showing posi- 
tive or negative concordance in 102/132 individuals 
(77.3%). Using a induration diameter of 10 mm as the 
TST cutoff value, the QFT-Gold and the TST results 
demonstrated 79.2% agreement (k = 0.23) in the RA pa- 
tients and 75.9% agreement (k = 0.19) in the healthy 
controls. In RA patients taking glucocorticoids and 
MTX, the agreement rates between the QFT-Gold and 
the TST tests were 79.1% (k = 0.28) and 78.9% (k = 0.21), 
respectively (Table 2). 

Using an induration diameter of 5 mm as the TST 
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64 RA 



79 Healthy controls 



3 TST-positive 
(12.5%) 



56 TST-negatlve 
(87.5%) 



20 TST-positive 
(25.3%) 



59 TST-negatlve 
(74.7%) 



0 QFT-Gold 
indeterminate 
(0%) 



8 QFT-Gold 
determinate 
(12.5%) 



11 QFT-Gold 
indeterminate 
(17.2%) 



45 QFT-Gold 
determinate 
(70.3%) 



0 QFT -Gold 
indeterminate 
(0%) 



20 QFT-Gold 
determinate 
(25.3%) 



0 QFT-Gold 
indeterminate 
(°%) 



59 QFT-Gold 
determinate 
(74.7%) 



3 QFT-Gold 


5 QFT-Gold 


positive (4.7%) 


nagative(7.8%) 



6 QFT-Gold 


39 QFT-Gold 


positive (9.4%) 


nagative (60.9%) 



4 QFT-Gold 
positive (5.1%) 



16 QFT-Gold 
nagative (20.2%) 



3 QFT-Gold 
positive (3.8%) 



56 QFT-Gold 
nagative (70.9%) 



Figure i. Flow-chart showing the distribution of QuantiFERON-TB (QFT-Gold) results in tuberculin skin test (TST)-positive 
and TST-negative patients with (A) rheumatoid arthritis (RA) and (B) healthy controls. 



Table 3. QuantiFERON-TB Gold positive test results according to different tuberculin skin test cutoff values 





TST cutoff values, mm 


Agreement between TST and QFT-Gold 


K 


95% CI 


RA patients (n = 53) 


5 


28 (52.8) 


0.05 


-0.23-0.32 


1 


10 


42 (79.2) 


0.23 


-0.18-0.64 I 




15 


44(83.0) 


0.23 


-0.23-0.69 


Healthy controls (n = 79) 


5 


45 (60.0) 


0.05 


-0.19-0.29 1 




10 


60(75.9) 


0.19 


-0.13-0.51 




15 


67(84.8) 


0.06 


-0.43-0.55 



Values are presented as number (%). 

TST, tuberculin skin test; QFT-Gold, QuantiFERON-TB Gold; CI, confidence interval; RA, rheumatoid arthritis. 



cutoff value, the agreement between the two test results 
was 28/53 (52.8%) and k = 0.05 in patients with RA and 
45/79 (60.0%) and K = 0.05 in healthy controls (Table 3). 
Using an induration diameter of 15 mm as the TST 
cutoff value, the agreement between the two tests was 
44/53 (83.0%) and K = 0.23 in patients with RA and 67/79 
(84.8%) and K = 0.06 in the healthy controls (Table 3). 

Of the 64 patients with RA, including those with in- 
determinate QFT-Gold results, we sub-analyzed the 
indeterminate QFT-Gold rates according to RF, MTX 
and glucocorticoid medication, and history of BCG 
vaccination (Table 4). In patients who had not received 
BCG vaccination, the rate of indeterminate QFT-Gold 
findings was significantly higher. No correlation was 
found between current glucocorticoid and MTX doses 
and RF positivity. 



DISCUSSION 

In this study, we found poor agreement between the 
results of the QFT-Gold test and the TST in patients 
with RA and healthy control groups (k = 0.23 in pa- 
tients with RA, K = 0.19 in healthy controls). Some 
studies have reported that there was a discrepancy be- 
tween the two tests in South Korea, an intermediate 
TB burden country [11,12]. However, the reported 
agreement between IFN-y assays and the TST was 
good (94% concordance in Denmark [k = 0.87] and 89% 
in the United Kingdom [k = 0.72]) in industrialized 
countries with low endemic TB [5,6]. Consequently, 
the incidence of TB is an important factor in agree- 
ment between the two tests. 

The concordance between the QFT-Gold test and the 
TST was also affected by immune status. There was 
also poor concordance between the IFN-y assays and 
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Table 4. Indeterminate results rate of the QuantiFERON-TB Gold test in patients with rheumatoid arthritis (n = 64) 





Indeterminate rate (%) 


p value 




Steroid dose (conversion to PDL) 


> 5 mg/day 


1/17(5.88) 


0.142 


1 


5 mg/day 


10/47 (21.28) 






MTX dose 


> 10 mg/wk 


1/37(2.70) 


0.076 




10 mg/wk 


10/27 (37.04) 






RF 


Positive 


2/28 (7.14) 


0.060 


J 


Negative 


9/36 (25.00) 






BCG vaccination 








Done 


2/30 (6.67) 


0.036 




Not done 


9/34(26.47) 







PDL, prednisolone; MTX, methotrexate; RF, rheumatoid factor; BCG, bacillus Calmette-Guerin. 



the TST in LTBI diagnosis among individuals infected 
with the human immunodeficiency virus [14]. Agree- 
ment between the two tests in immunosuppressed pa- 
tients with autoimmune diseases was also low [15]. In 
the case of patients with RA, some studies have shown 
generally poor concordance between IFN-y assays and 
the TST regardless of TB burden [16,17]. In Korean pa- 
tients with RA, similar studies showed poor agreement 
between the results of the two tests in immunocom- 
promised patients [12,13]. 

The PPD antigen used in the TST resulted in 
false-positive results in individuals vaccinated with 
BCG. In Korea, the BCG vaccination is performed at 
birth and again at age 12 or 13 if the child proves to be 
a TST nonresponder. In our study, poor agreement be- 
tween the two tests was investigated in the healthy 
control group. Not all participants in the healthy con- 
trol group had a past history of BCG vaccination. 
Thus, considering the ages of the participants, the 
poor agreement between the two tests was likely 
caused by confounding effects of previous BCG vacci- 
nation [18-21]. 

We subanalyzed the agreement between the TST and 
QFT-Gold results according to DAS28 disease activity, 
C-reactive protein, glucocorticoids, and disease-modi- 
fying antirheumatic drugs (DMARDs). Agreement in 
the results of the two tests in patients with RA who 
were taking MTX or leflunomide was poor (data not 



shown). Use of immunosuppressive agents and im- 
mune dysfunction may be related to RA with negative 
TST results [16,17]. 

The Korean guideline for the TST cutoff value for 
LTBI diagnosis before TNF-antagonist treatment is an 
induration > 10 mm [22]. By kappa analysis, we showed 
that the proper TST cutoff value for the highest concor- 
dance between QFT-Gold and TST results was 10 mm 
(Table 3). If we cannot rely on IFN-y assays to diagnose 
LTBI, it is appropriate that we replace IFN-y assay re- 
sults with a TST cutoff value of 10 mm. Similar to the 
TST, the overall sensitivity of the QFT-Gold test was 
low, but its specificity was generally higher than that of 
the TST in this study. 

In Korea, IFN-y assays are generally considered al- 
ternatives or complementary to the TST in the diag- 
nosis of LTBI. However, can IFN-y assays completely 
replace the TST? One weak point of the QFT-Gold test 
is its high incidence of indeterminate results, which 
may indicate, and also arouse clinical suspicion of an 
immune defect. Some factors, such as very young or 
very old age, immune deficiencies, and use of oral ste- 
roids, may be associated with a higher rate of indeter- 
minate results [23]. One study demonstrated an inde- 
terminate result rate of 11% (43/383 cases), which was 
associated with immunosuppressive treatment [24]. 
Ferrara et al. [25] reported that the rate of indetermi- 
nate results for the QFT-Gold was 5% to 40%, and was 
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significantly associated with elderly and immunocom- 
promised patients. However, the high rate of indeter- 
minate results of the QFT-Gold was anticipated to de- 
crease with QFT-GIT [25]. The overall QFT-Gold 
indeterminate result rate was 7.7% (11/143 cases) in the 
current study. All indeterminate QFT-Gold results 
were from RA patients who were TST-negative and 
none was from the healthy controls. It seems reason- 
able to assume that an immunosuppressed condition 
would induce a depressed response to a T cell reaction. 
These results support the idea that the TST is often 
unreliable among immunocompromised patients [4] 
and that an indeterminate QFT-Gold result did not 
usually correlate with a positive TST result. Our re- 
sults indicated that RA patients who had not received 
the BCG vaccination yielded higher indeterminate 
QFT-Gold rates compared with RA patients who had 
(Table 4). However, it is difficult to explain why BCG 
vaccination status should be related to indeterminate 
QFT-Gold results. Dose of glucocorticoids and MTX, 
positive rate of RF, and DAS28 did not influence the 
indeterminate QFT-Gold results in our study. These 
findings differed greatly from our expectations. More- 
over, some investigators have suggested that a signifi- 
cant proportion of negative TST results could also 
show indeterminate QFT-Gold results. Considering 
the small sample size of our study, it is difficult to as- 
sess whether factors associated with immunity, such 
as the use of steroids and DMARDs, can induce inde- 
terminate QFT-Gold results. 

Another factor could be age (mean age 44.4 ± 18.4 vs. 
median age 28 [range, 25 to 36]). Because BCG vaccina- 
tion was administered after infancy, TST administra- 
tion > 15 years after vaccination did not result in signif- 
icant reactions [19]. It is possible that the false-positive 
TST rates of our healthy controls were decreased be- 
cause these controls had lower BCG vaccination rates 
and were older and less affected by the BCG vaccina- 
tion than were the population in the study of Kang et 
al. [11]. To our knowledge, this is the first case-control 
study reported in Korea comparing two tests for the 
detection of LTBI in RA patients. We also investigated 
the clinical significance of indeterminate QFT-Gold 
results, which were commonly excluded in previous 
studies. Thus, investigations of clinical diagnoses 
(clinical symptoms, chest radiography, and/or chest 



computed tomography), patient medical histories (con- 
tact with TB patients), and environment (TB-endemic 
countries) are needed in the future. 

Our study had some limitations. First, the sample 
sizes of both groups were small, which may have af- 
fected the ability to detect differences. Second, this 
study was performed in a country with an intermedi- 
ate prevalence of TB. Thus, our results might be not 
generalizable to countries with lower or higher TB 
burdens. Third, there was a possibility of interobserv- 
er bias, because the TST induration measurements 
were performed by different observers in the two hos- 
pitals. Thus, further studies with larger sample sizes 
are required to confirm our findings. 

We recommend that the relevance of individual risk 
factors for TB and the interpretation of TST and QFT- 
Gold test results should be considered in the diagnosis 
of LTBI. Clinicians should pay particular attention to 
immunosuppressed patients with negative TST and 
indeterminate QFT-Gold results. Furthermore, more 
weight should be given to individual clinical factors 
than to equivocal test results. 

KEY MESSAGE 

1. Poor agreement between the QuantiFERON-TB 
Gold (QFT-Gold) test and tuberculin skin test 
(TST) in patients with rheumatoid arthritis and 
healthy controls was found in this study. 

2. We should pay particular attention to immu- 
nosuppressed patients with negative TST and 
indeterminate QFT-Gold results and always 
consider individual clinical factors more heavily 
than equivocal test results. 
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